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(57) Abstract 

An apparatus and method is disclosed for detecting, identifying, and classifying faults occurring in sensors measuring a process. If 
faults are identified in one or more sensors, tlie apparatus and mediod provide replacement values for tiie faulty sensors so tiiat any process 
controllers and process monitoring systems that use these sensors can remain in (q)eration during the fault period. The identification of faulty 
sensors is achieved through the use of a set of structured residual transforms that arc uniquely designed to be insensitive to specific subsets 
of sensors, while being maximally sensitive to sensors not in the subset. Identified faults are classified into one of the types Complete 
Failure, Bias, Drift, Precision Loss, or Unknown. 
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SENSOR VALIDATION APPARATUS AND METHOD 



5 



I. FIELD OF THE INVENTION 
10 The present invention pertains, in general, to process controllers and process 

monitoring systems that make use of sensors for measxiring process variables. In 
particular it relates to a system that detects and identifies one or more sensor faults, 
classiiles the types of sensor fault, and replaces erroneous sensor values with estimates of 
the correct process variable values. 

15 II BACKGROUND OF THE INVENTION 

Sensor validation is an important step for many model based applications in the 
process industries. Typical model based applications include model predictive control 
applications (MPC), and inferential sensing applications in which costly or infrequent 
measurements, available from laboratory samples or hardware analyzers, are replaced by 
20 regularly available inferred values from the model. 



In a typical MPC application, steady state optimization is performed to find the 
optimal target values for the controlled and manipulated variables. If the sensors are 
faulty, the optimized target values are not valid. Therefore, an effective sensor 
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it with the best reconstruction in order to maintain the control system on-line even 
though a sensor has failed. 

A typical inferential sensor application is in the area of predictive emissions 
monitoring systems (PEMS). Federal and/or state regulations may require air- 
S polluting plants to monitor their emissions such as nitrogen oxides (NO J, oxygen 
(O2), and carbon monoxide (CO). Hardware continuous emissions monitoring systems 
(CEMS) have both a high initial cost and a high maintenance cost. CEMS can be 
replaced by PEMS provided the PEMS is shown to be sufficiently accurate and 
reliable. One of the quality assurance requirements for PEMS is that each sensor that 
10 is used in the PEMS model be monitored for failure, and have a strategy for dealing 
with sensor failure so as to minimize down-time. 

The term sensor validation refers, for this patent application, to multivariate model 
based sensor validation. This is an approach which makes use of redundancy in the 
plant measurements. Typically sensor measurements exhibit a correlation structure 

15 which can be established by a training procedure using collected or historian data. 
This correlation structure can be monitored online; when the correlation structure is 
broken a possible sensor fault has occured. However the breaking of this correlation 
structure could also be due to process upset, process transition, or some other reason 
unrelated to sensor fault. The main objective is to determine if this really is a sensor 

20 fault and, if so, to identify the offending sensor. The various phases of sensor 
validation can be summarized as: 



• Detection This phase detects a change in the correlation structure; it may 
or may not be a sensor fault. 

25 • Identification This phase determines if this is a sensor fault and identifies the 
particular sensor 

• Estimation This phase estimates the size of the fault which allows 
reconstruction of the true value and replacement of the faulty value 
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• Classification This phase classifies the type of sensor fauU - complete failure, 
bias» drift, or precision loss 

Depending on the particular approach, these phases may overlap. There have been 
several patents granted that address the topic of multivariate model based sensor 
S validation. The key ones are: 

• Qin et al. US patent 5,680,409 "Method and Apparatus for detecting 
and identifying faulty sensors in a process'* 

• Keeler et al. US patent 5,548,528 "Virtual Continuous Emission 
Monitoring System" 

10 • Hopkins etal. US patent 5,442,562 "Method of contoUing a 
manufacturing process using multivariate analysis" 

Qin et al. address sensor validation within the context of process control. The 
preferred embodiment is based on PCA (Principal Components Analysis) and 
performs identification through an optimal reconstruction procedure: each sensor 
15 value is reconstructed on the assumption it is at fault, then identification and 
classification is done by tracking indices derived from the reconstruction error. 

Keeler et al. address sensor validation explicitly within the context of PEMS. The 
disclosed system focuses on the inferential sensor technology and the use of neural 
networks for PEMS. The sensor validation technology uses a sub-optimal 
20 reconstruction procedure for identification, does not address classification, and makes 
use of an "encoder" neural network which is a non-linear version of PCA. Encoder 
networks are also described in Mark Kramer "Nonlinear principal component analysis 
using autoassociative neural networks", AIChE Journal, 37 (2), pp. 233-243 (1991). 



25 (multivariate statistical process control), and make use of PCA or PLS (Partial Least 
Squares). Identification is by means of contribution analysis. Detection is achieved by 
monitoring principal component "scores" or score statistics and comparing with 
standard confidence intervals. Identfication is by examining the contributions of each 



Hopkins et al. address sensor validation within the context of process monitoring 
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original measurement to the offending score. The method does not attempt to classify 
fault types. 

Ill SUMMARY OF THE INVENTION 

The present invention provides a new apparatus and method for the detection, 
5 identification, estimation, reconstruction, and classification of faulty sensors. The 
approach makes use of a normal process model that can be built firom first principles 
or from data using statistical methods such as partial least squares (PLS) or principal 
component analysis. In the preferred embodiment, the process model is based on a 
PCA model in which the number of principal components is chosen to optimize the 
1 0 reconstruction of faulty sensor values as described in Qin and Duiiia '"Determining the 
number of principal components for best reconstruction", Proc. of the 5-th IF AC 
Symposium on Dynamics and Control of Process Systems, 359-364, Corfu, Greece, 
June 8-10, 1998. 

The detection phase uses a detection index based on the model equation error. An 
15 exponentially weighted moving average (EWMA) filter is applied to the detection 
index to reduce false alarms due to temporary transients. The filtered detection index 
{FDI) is compared to a statistically derived threshold in order to detect possible faults. 
Detection of a possible fault condition triggers the identification phase of the 
invention. 

20 The key component of this invention is the identification phase. To determine 

whether a detection alarm is due to one or more faulty sensors, and to identify the 
offending sensor(s), a series of detectors are constructed which are insensitive to one 
subset of faults but most sensitive to the others. These detectors are based on 
structured residuals (SRs) constructed by means of a novel approach referred to a 

25 structured residual approach with maximized sensitivity (SRAMS). Structured 

residuals are generally described in Gertler and Singer^ "A new structural firamework 
for parity equation based failure detection and isolation", Automatica 26:381-388, 
1990. An exponentially weighted moving average (EWMA) filter is applied to the 
SRs to reduce false alarms due to temporary transients. The SRs are also squared and 

30 normalized so as to equitably compare different SRs, Identification is achieved by 
comparing these normalized squared filtered structured residuals (NSFSRs) to 
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statistically inferred confidence limits. In addition to NSFSRs, indices based on the 
accumulation of the normalized structured residuals (NSRs) from the time of detection 
are monitored and compared for use in the identification of faulty sensors. Two such 
indices are the generalized likelihood ratio (GLR) index, and the normalized 
5 cumulative variance (NCUMVAR) index. The NCUMVAR index is primarily useful 
for identifying sensors with precision degradation. 

The fault magnitude is then optimally estimated based on the model, faulty data, 
and the assumption that the faulty sensors have been correctly identified. This uses 
public domain prior art described, for example. Martens and Naes ""Multivariate 
10 Calibration", John Wiley and Sons, New Yorky 1989. Knowledge of the fault direction 
(known from the identification of the faulty sensors) and the estimated fault 
magnitude is then used to reconstruct estimates of the correct sensor values. 

The fault classification phase provides diagnostic information as to the type of 
sensor fault. Specifically, four types of fault are considered: Complete Failure^ Bias, 

1 5 Drifts and Precision Loss. Complete failure is determined by performing a regression 
analysis on an identified faulty sensor's measured values, and is indicated by the 
statistical inference that the regression line has zero slope. The other three types of 
fault are classified by performing a regression analysis on the estimated fault sizes 
since the time of identification. Bias is indicated by the statistical inference that the 

20 estimated fault size regression line has zero slope and non-zero offset, and has small 
residual error. Drift is indicated by the statistical inference that the estimated fault size 
regression line has non-zero slope, and has small residual error. Precision Loss is 
indicated by the statistical inference that estimated fault size regression line has zero 
slope, zero offset, and significant residual error. Precision Loss is also indicated if the 

25 fault is identifiable only by the NCUMVAR index. 

IV BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features, and advantages of the invention will 
be apparent from the following more particular description of preferred embodiments 
of the invention, as illustrated in the accompanying drawings in which like reference 
30 characters refer to the same parts throughout the different views. The drawings are not 
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necessarily to scale, emphasis instead being placed upon illustrating the principles of 
the invention. 

FIG. 1 shows the eight computational units of the preferred embodiment of the 
invention and the relationships between these units. 

S FIG. 2 shows a flow diagram of the identification process in the embodiment of FIG. 
1 . 

FIG, 3 shows a flow diagram of the classification process in the embodiment of FIG. 
1 . 

FIG 4 shows the detection index of the present invention n^iidly increasing and 
10 exceeding its threshold on the introduction of a fault to a boiler process. 

FIG, 5 shows the output of the Estimation Unit on introduction of a bias fault into 
sensor 2 of a boiler process. 

FIG, 6 shows the output of the Estimation' Unit on introduction of a drift fault into 
sensor 5 of a boiler process. 

1 5 FIG, 7 shows the NSFSR indices of the present invention in response to the 
introduction of a drifl fault into sensor S of a boiler process. 

V DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The sensor validation apparatus 100 of this invention is shown in FIG, 1 , The 
extemal input to the sensor validator consists of sensor measurements 108, which may 

20 include status information, as might be available, for example, iBrom a Distributed 

Control System (DCS) 50 in a manufacturing plant. The purpose of the invention is to 
use redundant information in the sensor measurements to detect when a sensor has 
failed, and, optionally, to provide a replacement value for a failed sensor. Other 
devices such as a process controller 60 or inferential sensor 70 that make use of the 

25 sensor measurements can then use the replacement values if necessary. This allows 
these devices to continue operation in the presence of failed sensors. 

Referring again to FIG, 1 , the sensor validator 100 consists of eight 
computational units that implement the various phases of sensor validation. These 
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computational units, which may be implemented using a microprocessor or any other 
desired type of computer, are as follows: 

• A Pre-processing Unit 110, which maintains scaling and offset information 112 to 
convert the vector of sensor values 108 from the DCS 50 to a vector of normalized 

S values 118. These normalized values have standardized units for which, in the 

preferred embodiment, the values are designed to have a mean of 0 and a standard 
deviation of 1 . This is necessary for building an effective model matrix 122, 
detection index 142, and structured residual transfomis 132 for identifying faulty 
sensors. The scaling and offset infonnation is, in the preferred embodiment, 
10 derived from a statistical analysis of a historical set of sensor data. 

• A Model Unit 120, which maintains a model matrix 122 to convert the vector of 
pre-processed sensor values 118 at a given instance to an error vector referred to 
as the equation error 128. The equation error is used by the Structured Residual 
Unit 130 to calculate structured residuals values 138 and fault sizes 136, and by 

15 the Detection Unit 140 to calculate the detection index 142. The Structured 

Residual Unit also uses the model matrix to design structured residual transforms 
132 and their corresponding fault estimation transforms 134. The model matrix is, 
in the preferred embodiment, built from a historical set of sensor data using 
Principal Component Analysis. 

20 • A Structured Residual Unit 130, which maintains a working set of structured 
residual transforms 132 that convert the current equation error 128 to a set of 
structured residual values 138. The Identification Unit 150 uses these structured 
residual values to determine the identity of any faulty sensors. The Structured 
Residual Unit also maintains a set of fault estimation transforms 134 that are used 

25 by the Estimation Unit 160 to obtain normalized fault sizes 136 for identified 

faults. 

• A Detection Unit 140, which calculates a detection index 142 from the equation 
error 128, and compares the detection index to detection threshold 144. If the 
detection index exceeds the detection threshold, then a detection event 148 is 

30 generated. This detection event is used to activate the Identification Unit 150, and 
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is also available externally to the sensor validator, for example for operator alarm 
generation or event logging to an operator console 90, or to a storage device 92. 

• An Identification Unit ISO, which uses the structured residual values 138 to 
calculate several sets of identification indices 152. If a detection event 148 has 

5 occurred, then the Identification Unit attempts to identify the nature of the fault by 
comparing the identification indices to a corresponding set of thresholds 154, 
according to a certain logic, described in detail later. If identification is successfiil, 
an identification event 158 is generated which is used to activate the Estimation' 
Unit. This identification event includes information as to which sensors failed, and 
10 is also available externally to the sensor validator, for example for operator alarm 
generation or event logging to an operator console 90, or to a storage device 92. 

• An Estimation Unit 160, which is activated by an identification event 158. The 
Estimation Unit requests the Structured Residual Unit 130 to s^ply the appropriate 
fault estimation transform 134 (chosen based on identification information) to the 

1 5 equation error 128, resulting in normalized fault size information 136. The 

Estimation C/m7 then applies the appropriate scaling 116 to 136, in-order to 
produce fault size estimates 168 scaled to the units of the original sensor values. 

• A Replacement Unit 170, which subtracts the estimated fault sizes 168 firom the 
corresponding faulty sensor measurements 108, to obtain a set of replacement 

20 values 178. These replacement values are available externally to the sensor 

validator, for example they are written to the DCS 50 for use by other devices. 
The Replacement Unit is only active when the Estimation Unit 160 is active. It can 
also be deactivated by request of an opmtor 172; in this case the output 178 of the ' 
Replacement Unit is identical to the original input 108 to the sensor validator. 

25 • A Classification Unit 180, which calculates diagnostic information as to the type 
of sensor fault. Specifically, four types of fault are considered: Complete Failure, 
Bias, Drift, and Precision Loss. The Classification Unit is only active when the 
Estimation Unit 160 is active, which, in turn, is only active when an identification 
event 158 has been generated. The classification is based on an analysis of the 

30 sensor data 108 and the fault size estimations 168 since the time of identification. 

The classification information 188 produced by the Classification Unit is available 
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externally to the sensor validator, for example for operator alarm generation or 
event logging to an operator console 90, or to a storage device 92, 

A detailed description of the preferred embodiment of each of these computational 
units now follows. 

5 V.1 PRE-PROCESSING UNIT 

The Pre-processing Unit 110 calculates and maintains scaling and offset 
information to convert between measured sensor values 108 from the DCS and 
normalized values 118 for inputting to the Model Unit and the Structured Residual 
Unit. The scale value5,-and offset value o, for the sensor are, in the preferred 
10 embodiment of this invention, calculated from the mean //^and standard deviation cr. 
of the sensor as follows: 
_ J_ 

'''a, (1) 

Then a measiu-ed value m. of the i^ sensor is converted to a normalized value x^hy: 

15 «,=5,(x,-o,) (2) 

//,. and are estimated from representative sample data in the standard way well 
known to those skilled in the art. 

V.2 MODEL UNIT 

The Model Unit 120 maintains a normal process model, which can be 
20 represented by the following equation: 

Bx*(0 = e*(0 (3) 

where x* e 5R" is a vector of preprocessed sensor values, B € SI""*" is the model 
matrix 122, and e* e 91" is the equation error 128. The matrix B can be derived from 
mass balance or energy balance of the process, or it can be generated from process 
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data using statistical methods such as Principal Component Analysis (PCA) or Partial 
Least Squares (PLS). 

V.2,1 MODEL UNIT BASED ON PCA 

In the preferred embodiment, the normal process model is derived from 
5 process data using PCA. PCA is generally described in, for example, J. Edward 
Jackson "A User's Guide to Principal Components' VoA/i Wiley 1991. In PCA the 
sensor values x * (/) e 91" are decomposed into: 



10 where P e gci are the eigenvectors associated with the principal eigenvalues 

Jl^ >A^ > A /I of the correlation matrix of x * (/) . In this case, the model equation 

error e * (/) corresponds to the residual components {A„^„+i ,A ), and, as described 

in Gertler , Li, Huang and McAvoy "Isolation enhanced principal component 
analysis" Proc, IF AC Workshop on On-line Fault Detection and Supervision in the 
1 5 Chemical Process Industries^ 4-5 June, 1998, 



In the preferred embodiment, the optimal number of principal components is 
chosen for optimal reconstruction c^ability as described in detail in Qin and Dunia 
"Determining the nimiber of principal components for best reconstruction". Proa, of 
20 the 5'th IFAC Symposium on Dynamics and Control of Process Systems^ 359-364, 
Corfu, Greece, June 8-10, 1 998. 

V.3 STRUCTURED RESIDUAL UNIT 

The Structured Residual Unit 130 maintains transforms that are sensitive or 
insensitive to faults in certain directions. These transforms are described in the context 
25 of the following fault representation. 



x*(/) = PP'^x*(0+PP''x*(0 



(4) 



(5) 
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V.3.1 FAULT REPRESENTATION 

Under normal conditions, the equation error e * (t) 128 contains mainly 
measurement noise, which can be assumed to be zero mean Gaussian noise. When a 
sensor fault occurs, the sensor measurement will contain the normal values of the 
5 process variables and the fault, i.e., 

x(r)=x*(/)+S,f,(0 (6) 

where f.(/)€ ?R'^ is a vector of the fault magnitude, and E. e 9?"''' is a matrix of fault 
directions. To represent a single sensor fault in the sensor 

S^=[0 0 A 1 A of (7) 

10 which is the /"* column of the Identity matrix. To represent simultaneous multiple 
sensor faults, simply contains the corresponding columns of the identity matrix. 

Using the measurement relation of equation 6 that contains a sensor fault, the equation 
error 128 can be written as follows: 

e(0 = Bx(r) = Bx * (0+ BS,f,(0 = e * (/)+ BS.f, (/) (8) 

15 The fault will in general cause the equation error e(/)to increase. The magnitude of 
the equation error is used to detect sensor fauhs as described later. Since a distinct 
vector or matrix S, represents each sensor fault, fault identification can be 
accomplished by using the direction vectors. 

V.3.2 STRUCTURED RESIDUAL TRANSFORMATIONS FOR SINGLE FAULTS 
20 The Structured Residual Unit 130 maintains a set of transforms referred to as 

structured residuals. The Identification Unit ISO, described in a later section, uses the 
structured residual transforms to identify faulty sensors. 

Structured residuals are generally described in Gertler and Singer, "A new 
structural framework for parity equation based failisre detection and isolation", 
25 Automatica 26:381-388, 1 990. In the present invention, a new design method for 
structured residuals is disclosed, referred to as "Structured Residual Approach with 
Maximized Sensitivity" or SRAMS. 
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For the case of single sensor fault in the y sensor, 

BS;=b^- (9) 

where is the column of matrix B . Therefore, the model equation error is 

e(/) = e*(/)+b^/,(0 (10) 

5 With a selected residual structure, a set of structured residuals r(r) can be generated 
by pre-multiplying the equation error vector e(/)by a transfonnation matrix W , 

r(0 = We(/) (11) 

It is desirable to design each element of r(r) to be responsible for one particular 
sensor fault but not responsible for other faults. The i'* element of r(/) given that the 
10 y* sensor is faulty is represented as 

r^.(/)-wre(r)=w[e*(/)+wfb^/^(0 /,y = 1,2,A ,« (12) 

where w[ is the /'* row of matrix W e 9^'^'" . Since e(/) is randorai noise, one can 
only design the residual r^(/) to be sensitive or insensitive to , the fault direction 
vector. The SRAMS design criterion is stated as follows: 

1 5 Choose such that r^. (/) is insensitive to the z * sensor fault but most 

sensitive to the others. Mathematically, tiiis is equivalent to 



maxV- 



subject to: 
w[b,. = 0 

20 Geometrically, w,. is chosen to be orthogonal to b^ , while minimizing its 

angle to other fault directions b^ j^i. This problem can be equivalently stated as 
follows: 
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maxXCwrb;)* (13) 



subject to: 



where 



wfb;=0 

Hl=i 



b'j^Pj y = 1.2,A.n (14) 



Ji 



(16) 



To satisfy the constraint w, b° = 0 , the vector w,mxist be chosen as follows: 

w, = t-bX'Ke5«,. z,e9l- (15) 

where S^^ is the orthogonal complement of b; . Therefore, the solution of w,. is 
converted to the solution of z . . Using a Lagrange multiplier >l , the solution of z,. can 
10 be found by maximizing the following objective: 

y = max(^Xk(l-W')>-)'+^(l-<(l-bX'K)] 
= max(^|:(zr(l-b?bf),;)'+^(l-zf(l-bX''Kj) 

. The above relation holds because (l-b?b?^)[>f =0 . Denoting 

[b? A b:]sB^ (17) 

and 

15 ^-bfbfjbf A b^]=(l-b;b?^)8^ sB; (18) 

which is the projection of B*" onto S^^ , the maximization problem can be rearranged 

as follows: 

y = m^ax[^||B;\| +.l(l-zf (l-bfbf (19) 
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Differentiating J with respect to leads to 

B;Br''z,=>l(l-b;bf )z, (20) 
Note that 



(21) 



Equation 20 can be rearranged as 

(i-b;b?'")(B;Brz,-.iz,)=o 



or 



B?B;\-ylz, =0 (22) 

Therefore z . is the eigenvector of B^B^^ that corresponds to the largest eigenvalue. 
10 After Z; is known, can be easily calculated from equation 15. 

V.3.3 STRUCTURED RESIDUAL TRANSFORMATIONS FOR MULTIPLE FAULTS 

The SRAMS design method can be extended to the case in which multiple 
sensors fail simultaneously. The equation error vector for multiple sensor faults is 

e(0 = e*(f)+b,S,f,(0 (23) 

15 where BS . e «H"''^ contains q columns of B corresponding to the failed sensors, and 
f^(/) € 51* is a vector of the fault magnitudes. Note that the colunms of BH,- can be 
linearly dependent. Performing a singular value decomposition (a matrix 
decomposition well known to those skilled in the art) on B5; and keeping only non- 
zero singular values yields 

20 /X /X (24) 

= e*(/)+U,f,(/) 

where 
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f,(0=l>,V;f,(/) (25) 

To design for multiple sensor faults, is chosen in the orthogonal complement 
of , that is 

w,=(l-UXK^5w. (26) 

5 similar to the single sensor fault case. Furthermore, the following objective is 
maximized: 

m«|zj(l -U,Uj)Bf = max|z,^B;f (27) 
subject to 

||(l-UXK| = l (28) 

10 where 

B;=(i-UX)b' (29) 

After using a Lagrange multiplier, is found to be the solution to the following 
equation: 

B;Bf2,=>l(l-UXK (30) 

1 5 From 29 we obtain 

(i-uxkBr:^,-'i^)=o 

or 

BlBfz^^Az^ (31) 

Therefore, z^ is simply the eigenvector of BJBJ^ associated with the largest 
20 eigenvalue. 
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V.3.4 COMPARISON TO CONVENTIONAL STRUCTURED RESIDUAL APPROACH 

The conventional structured residual approach (Gertler and Singer, "A new 
sUructural framework for parity equation based failure detection and isolation", 
Automatica 26:381-388, 1990, and Gertler and Singer, "Augmented models for 
5 statistical fault isolation in complex dynamic systems". Proceedings of the American 
Control Conference, pp3I7-322, 1985) chooses to be insensitive to a particular 
fault of interest, but it does not maximize the sensitivity to other faults. In a typical 
structured residual design, the selecting of w^is not unique and is somewhat arbitrary. 
The arbitrariness in this design leads to a sub-optimal solution that does not maximize 
10 the potential to isolate faults. The SRAMS approach of the present invention 

embodies a unique design of w^that maximizes the sensitivity to other faults while 
being insensitive to the fault of interest. 

V.3.5 TRANSFORMATIONS MAINTAINED BY THE STRUCTURED RESIDUAL 
UNIT 

15 In the preferred embodiment of Uie invention, the Structured Residual Unit 

maintains a core set of structured residual transforms corresponding to single sensor 
faults as described in section V.3.2. These core structured residual transforms form the 
initial working set of structured residual transforms 132 and associated fault 
estimation transforms 134. 

20 When one or more sensors measurements 108 from the DCS are marked as 

bad on input to the sensor validator, a new working set of structured residual 
transforms, and associated fault estimation transfonns, is created by the Structured 
Residual Unit, These are as follows: if & sensors are marked as bad on input, then w- 
b+1 new structured residual transforms are designed. The first structiu*ed residual 

25 transform is designed with a S that selects the columns of the identity matrix 

corresponding to the b bad sensors; this structured residual transform is insensitive to 
these bad sensor values but is sensitive to faults in any of the other sensors. The 
remaining n-b structured residual transforms are designed with a S which selects the 
columns of the identity matrix correspond to the b bad sensors plus one more column 

30 corresponding to each other sensor in turn. This allows the identification of a fiirther 
faulty sensor in addition to those marked as bad on input. 
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Other structured residual transforms can optionally be designed and added to 
the working set. For example, a set of transforms based on a S that selects all pairs of 
columns from the identity matrix. This allows identification of pairs of simultaneous 
faults. However, a preferred method of detecting multiple faults is to use several 
5 sensor validators. For example, in FIG. 7 , if a process controller 60 uses 5 sensor 
values as inputs, up to 5 sensor validators 100 can be utilized, one for each input of 
the controller. Each sensor validator uses one of the inputs together with other 
redundant sensor measurements that are not input to the process controller. 

Another scenario is to have several sensor validators, each optimized for 
10 detection and identification of faults in particular sensors, feeding another sensor 
validator that is optimized for reconstruction. 

V.4 DETECTION UNIT 

The Detection Unit 140 monitors the correlation structure of the pre-processed 
sensor values by calculating a detection index 142 based on the current equation error. 
15 If this detection index exceeds a threshold 144 based on a statistically inferred 

confidence limit, a detection event 148 is generated, and the Identification Unit is 
activated. In the preferred embodiment a filtered normalized fault detection index 
(NFFDI) is used as described below. 

V.4.1 FAULT DETECTION INDEX 
20 The fault detection index {FDI) is defined as follows 

Fi)/ = l|e(/f ==||e*(r)-HBS,f,{/f (7) 

When no fault is present, FDI = ||e * {if = ||Bx ♦ {tf . Therefore, the detection alarm 
threshold for FDI is actually the confidence limit for |e * iff . 

V.4.2 NORMALIZED FAULT DETECTION INDEX 
25 In practical industrial processes, the process variables x * if) typically are not 

normally distributed. However, the equation error e* (/) 128 contains mainly 
measurement noise and therefore can be considered zero mean Gaussian noise. As a 
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consequence e * {tY R j'e * (r) satisfies a distribution with m degrees of freedom, 
where = £|b(/)c^ (/)} is the equation error covariance matrix. Thus defining the 
normalized fault detection index as 



the detection alarm threshold for for NFDI can be determined, in a manner well 
known to those skilled in the art, for any significance level a using knowledge of the 
distribution. 



Note that NFDI s |n(/)[p where r|(r) = R^^e(/) and R^^ is the matrix square 



root of the inverse equation error covariance matrix. R,^ has the effect of 
decorrelating the equation error. 

V.4.3 NORMALIZED FILTERED FAULT DETECTION INDEX 
In the preferred embodiment, an exponentially weighted moving average (EWMA) 
filter is applied to the equation errors in order to reduce the effect of transients and 
noise in the measured data: 



NFDI = e{tyR;'e{t) 



e(r) = - 1)+ (1 - rMO 0 < r < 1 



(32) 



It directly follows that 



e(0=(i-r)i:A(^-*) 



and 



00 



(33) 



where 



(34) 
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The filtered normalized fault detection index 142 is defined as 

NFFDI^piitf (35) 

Without faults, since ti(/) is normally distributed, Ti(/)is also normally distributed 
5 with E{y\{t)} = E{^{t)} = 0 . However, since the EWMA filter significantly reduces the 
variance of Tf(r), the confidence limit can not be applied to directly. The 
variance of 7\{t) is given by: 

= Y^Mii"(/)n(0(i+2|;rV(*)) (36) 

= var(n«)y^[n-2|:rV(*)j 

where 

is an autocorrelation fiinction. If T](f) were independently and identically 
distributed, /7(^) would be 0 for any k>0. However, for practical data, this condition is 
hardly satisfied due to dynamic transients. The non-zero p{k) on the right hand side 
of equation 36 will contribute to the determination of the detection alarm threshold for 
15 d^ . Since the threshold for ||Ti(/)j|^ is d^ , from equation 36, it is straightforward that 
the detection alarm threshold 144 for ||T](/)lf is: 



d^^d (l^2±r' P(k)]\^ (38) 
Notice that \p{k)^ < 1 , and therefore 
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(39) 



Therefore, the threshold for NFFDI is normally smaller than that for NFDL In 
practice, /? (A:) decays to zero after some time hence, the Detection Unit only 
maintains a fixed number of terms in order to calculate . The significance ^ is an 
adjustable parameter of the Detection Unit, 

FIG, 4 shows how the A(FFZ>/ rapidly increases on the introduction of a fault. 

V.5 IDENTIFICATION UNIT 

The Identification Unit 150 is activated if the Detection Unit generates a 
detection event. The Identification Unit calculates several sets of indices 152 that are 
used to determine if a detected fault can be identified with the failure of one or more 
sensors. Each set of indices is derived firom the working set of structured residuals 
maintained by the Structured Residual Unit 130. In general, if a single index in a set is 
less than a threshold, whereas all other indices in the set are greater than the threshold, 
then a fault of known direction is identified: The direction of this fault corresponds to 
directions that define the structured residual associated with the index. In the most 
typical case this corresponds to a fault in a single sensor. 

In the preferred embodiment of this invention, iht Identification Unit 
maintains 3 sets of indices 152 and their associated thresholds 154. These sets of 
indices are the Normalized Squared Filtered Structured Residuals (NSFSR), the 
Generalized Likelihood Ratio (GLR) indices, and the Normalized Cimiulative 
Variance (NCUMVAR) indices. The associated thresholds are denoted by iPf^spsx* 
^GLR > "^NCUMVAR ' ^ ^^w diagram that summarizes the fault identification process 
is shown in F/G. 2. 
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V.5.1 NORMALIZED SQUARED FILTERED STRUCTURED RESIDUAL 

Ideally, each structured residual rg{t) is supposed to be zero or close to zero 
when no sensor fails. However, due to modeling error, measurement noise and other 
uncertainties, r,(^) is never equal to zero. Therefore, the non-zero confidence limit for 

S each r,(r) Uj = 1,2, A ,72 is determined using statistical techniques. 

Without a fault or with the sensor(s) associated with the structured residual 
being faulty, the /'* structured residual follows a normal distribution, 

r,(/) = wfc(r)-- k(0, wfR.w.) i = 1,2,A ,« (40) 

where = £{e{/)e'^(/)} is the equation error covariance matrix. 

10 Consequently 

Z'{^) i = U,A./i (41) 

w, R,w, 

Then, defining the z'* normalized structured residual (NSR) as 

K,(0^ ^'(^^ ~K(0.1) (42) 
Vw, R,w, 

and defining the normalized squared stiuctured residual (NSSR) as yf{t), the 
1 5 confidence limit for NSSR is j^l (l) where <ar is the level of significance. 

When an EWMA filter is applied to the NSR, the normalized filtered 
structured residual (NFSR) is 

= (i-r)Z;'*K'-*) ^""^^ 

Without a fault or with the sensor(s) associated with the z '* structured residual being 
20 faulty, the NFSR also follows a normal distribution with 

E{y,{t)} = E{y,it)}='0 

and 
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varl 



(7,(0) = y^vMrr-i^ + 2|:rV, ik)] 

l + k.l J 



(44) 



where 



E{y,{t)yXt-'k)} 



10 



15 



is an autocorrelation function. 

Therefore the alarm threshold for the normalized squared filtered structured 
residual (NSFSR) defined by Vg^ (r) has an alarm threshold of 



If the sensor(s) associated with the structured residual are faulty, by the SRAMS 
design, v^^ (/) is not affected by the fault. However, the other residuals, vj (/) 7^1, 
will increase significantly because their sensitivity to the faults in other sensors is 



Therefore, with a selected level of significance a and an instant /, among NSFSRs^ 
the existence of exactly one NSFSR that is less than its threshold SlfsFSR identifies a 
faulty sensor, and generates an identification event 158. An example of this is shown 
in FIG. 7 in which the top window shows the NSFSRs that do not correspond to 
faulty sensor S become very large, whereas the bottom window shows the NSFSR for 
sensor 5 remains below its threshold. 

Since there are often many sensors to be validated, the probability for at least 
one residual to exceed its threshold is significant, even though the probability for each 
index to exceed its threshold is small. For example, assimiing that there are 20 
residuals r. (/) / = 1,2,A 20 . The probability for at least one NSFSR to exceed its 
threshold is (assuming a = 0.05 ) 




(45) 
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P = 1 - (l - ^)'° = 1 - 0.95 " = 0.642 



even though all sensors are normal. Therefore, the NSFSRs are not used for fault 
detection. Instead, the Detection Unit uses the NFFDI to trigger a detection event after 
which the Identification Unit uses the various sets of indices, starting with the 
5 NSFSRs^ to identify the faulty sensors. 

Optionally, the NSFSR indices can be calculated at each cycle, whether or not 
the Detection Unit has generated a detection event. However, the index sets described 
in the next two sections accumulate structured residual information since the time of 
fault detection, so they only make sense after a detection event has been generated. 

10 V.5.2 GENERALIZED LIKELIHOOD RATIO INDEX 

If a sensor fault incurs significant changes in the mean, e.g., complete failure, 
bias, or drift, the generalized likelihood ratio {GLR) is usually an appropriate test for 
detecting this (Benveniste, Basseville and Moustakides 'The asymptotic local 
approach to change detection and model validation" IEEE Trans. Auto. Cont. 

15 32(7):538-592, July 1987. 

To clarify the following analysis, each structured residual transform is 
assumed to correspond to a fault in a single sensor. In general, however, the GLR 
indices can be constructed and monitored irrespective of the structured residual 
design. 

20 As shown by equation 42, when no sensor is faulty v^t) is zero-mean and 

normally distributed, with imit variance. However, if the j'* sensor becomes faulty at 
. instant / . it is clear that 




(46) 



is no longer zero-mean but the variance is unchanged. In other words 



25 




(47) 



where 
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It should be noted that //^. = 0 by the SRAMS design. 

To detect the mean change of ^/(/) , define the following GLR function 

£►•,'(*)- i(.',W-/',)' 

5 Differentiating {//y ) with respect to produces the optimal estimate of //^ 

^''T^l (50) 
With //y , S/^ {/£y ) is maximized with 

SlM=^l (51) 
If the y* sensor is faulty, = 0 , and ~ N(0,r) . From equation 50, 

10 />^(Or~X(0,l) 

or 

Therefore, with a selected level of significance a and an instant r» among the n GLRs 

IS the existence of exactly one GLR that is less than the threshold S^^jj^ = zli}) identifies 
a faulty sensor, and generates an identification event 158. 
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V.5.3 NORMALIZED CUMULATIVE VARIANCE INDEX 

If a sensor incurs a precision degradation fault, the GLR index set will have 
difficulty identifying it. To identify the location of precision degradation faults, the 
mean and variance of the NSR is calculated since the time the fault occurred: 

NCUMMEAN,. {t) = — - ^ ^/ (*) 

NCUMVAR, (/) = — ^ X! (*) " NCUMMEAN, (/)) 

Assuming, for clarity of explanation, each structured residual transform corresponds 
to a fault in a single sensor, when either no sensor or the f '* sensor fails, 

NCUMVAR,{f)'--^X^{t-tf -l) 

Therefore, with a selected level of significance a and an instant t, among the n 
1 0 NCUMVARs, the existence of exactly one NCUMVAR that is less than the threshold 

^NcuMVAR ~ — ^ — z\ *" 0 identifies a sensor with precision fault, and generates 
an identification event 158. 

V.6 ESTIMATION UNIT 

The Estimation Unit 160 is only active if the Identification Unit 150 has 
1 5 generated an identification event 158. The Estimation Unit then optimally estimates 
the fault magnitude based on the model, the faulty data, and the matrix E,. 
corresponding to the structured residual transform that was instrumental in generating 
the identification event. This optimal estimation is based on public domain prior art as 
described, for example. Martens and Naes ""Multivariate Calibration", John Wiley 
20 and Sons, New York, 1 989. 

The optimal estimation is achieved by choosing a time function (/)in the 
direction where, as in equation 24, is the orthogonal left hand side matrix of a 
singular value decomposition on BS^ in which only non-singular values are 
maintained. In other words, minimize 
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(52) 



A least square solution to this problem leads to: 



f,(0 = u;e(r) 



(53) 



The original fault magnitude f,(/) can be estimated using equation 25: 



^(0=(DX)*f,(0 



(54) 



where ( )* is the Moore-Penrose pseudo-inverse, well known to those skilled in the 
art. The Structured Residual Unit 130 maintains the estimation matrix 134 



for each structured residual it maintains. The estimation matrix corresponding to the 
structured residual that identified the fault is used to map the equation error 128 to an 
estimate of the fault vector in the pre-processed sensor value space 136. The 
Estimation Unit then applies the inverse scaling 116 from the Pre-processing Unit 
resulting in an estimate of the fault vector in the original sensor space 168: 



FIG, 5 shows the output of the Estimation Unit for a bias fault in Sensor 2. FIG, 6 
shows the output of the Estimation Unit for a drift fault in Sensor 5. In both cases the 
fault size is accurately estimated. 

V.7 REPLACEMENT UNIT 

The Replacement Unit 170 simply takes the estimate of the fault vector in the 
original sensor space 168 as estimated by the Estimation Unit (equation 56) and 
subtracts the estimated fault from the measured vector of sensor values 108 to produce 
a vector of replacement values 178: 



The Replacement Unit is only active if Estimation Unit 160 is active, which in turn is 
only active if the Identification Unit 150 has generated an identification event 158. In 




(55) 




(56) 



«(/)=u(0-f„(0 



(57) 
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addition, as a safety feature, an operator of the apparatus can explicitly disable (172) 
the Replacement Unit. 

V.8 CLASSIFICATION UNIT 

The Classification Unit 180 calculates diagnostic information as to the type of 
5 sensor fault. Specifically, four types of fault are considered: Complete Failure^ Bias, 
Drift, and Precision Loss. 

The Classification Unit is only active when an identification event 158 has 
occurred. From the point when a sensor is first identified as being faulty, a buffer of 
measured sensor values is maintained and a buffer of estimated fault sizes for that 
10 sensor is also maintained. The information in these two buffers is analyzed and used 
to classify the type of fault for that sensor. The analysis primarily makes use of 
statistical inference, so a significance level a is required which is an adjustable 
parameter of the Classification Unit. 

For clarity of explanation, assume that a single sensor fault has been identified 
15 by the Identification Unit 150. A flow diagram of the classification logic is shown in 
FIG, 3 . 

V.8.1 CLASSIFICATION TYPE: COMPLETE FAILURE 

Complete failure is determined by performing a regression analysis on the 
faulty sensor's measured values 108, and is indicated by the statistical inference that 
20 the regression line fits well, and has zero slope. 

Let {k,Ui{k)^k = tfj ,A be the sequence of points for which the regression 

line is calculated, where t^ is the point at which the sensor was identified as faulty, 

and / is the current point in time. 

Using standard least squares regression, which minimizes the residual between 
25 the points and the best fit line, the slope and y-intercept a are estimated as: 
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±{k-kXu,{k)-u,) 



where 



k — i — y* 

(59) 



To test if the slope is statistically equal to 0, construct the following statistic: 



where the standard deviation of is given by 

Sdp)^-^ . (61) 



and the standard deviation a of the residual is estimated by 



Z<?(*) 

10 where 

is the residual error. 

The statistic given in equation 60 satisfies Student's t distribution with 
r - - 1 degrees of freedom (see, for example Birkes and Dodge "AUemative 
15 Methods of Regression", John Wiley & Sons 1993). 
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Goodness of fit of the regression line is determined by the linear correlation 
coefiicient exceeding a specified threshold. 

V.8.2 CLASSIFICATION TYPE: BIAS 

Bias is determined by performing a regression analysis on the faulty sensor's 
fault size estimates 168 as calculated by Estimation Unit 160, and is indicated by the 
statistical infwence that the regression line fits well, has zero slope, and has non-zero 
bias. 

Let {k^fXk\k = r^,A ,r} be the sequence of points for which the regression line is 
calculated, where is the point at which the sensor was identified as faulty, and t is 
the current point in time. Testing for zero slope is the same as for classifying 
Complete Failure^ except that the fault size sequence / (Jt) replaces the sensor value 
sequence u^ik). Goodness of fit of the regression line is determined by the linear 
correlation coefficient exceeding a specified threshold. 
To test for non-zero bias, calculate the statistic: 



which also satisfies Student's t distribution with t -/^ -1 degrees of fireedom. 

V.8.3 CLASSIFICATION TYPE: DRIFT 

Drift is determined by performing a regression analysis on the faulty sensor's 
fault size estimates 168 as calculated by Estimation Unit 160, and is indicated by the 
statistical inference that the regression line fits well, and has non-zero slope. 

V.8.4 CLASSIFICATION TYPE: PRECISION LOSS 

Precision Loss is determined by performing a regression analysis on the faulty 
sensor's fauh size estimates 168 as calculated by Estimation Unit 160, and is 
indicated by the statistical inference that the regression line does not fit well, and has 
zero slope, and has zero bias. 




(63) 
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Precision Loss is also, indicated if the identification event 158 was generated 
due to the NCUMVAR test of section V.5.3. 

V.9 EQUIVALENTS 

Although the foregoing details refer to particular preferred embodiments of the 
S invention, it should be understood that the invention is not limited to these details. 
Substitutions and alterations, which will occur to those of ordinary skill in the art, can 
be made to the detailed embodiments without departing from the spirit of the 
invention. These modifications are intended to be within the scope of the present 
invention. 
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CLAIMS 

What is claimed is: 

1 . An apparatus for detecting one or more sensor faults in a measured process 
comprising: 

A pre-processing unit for receiving a working vector of signals including 
measured sensor values, the pre-processing unit normalizing the 
measured sensor values, resulting in pre-processed sensor values; 

A model unit coupled to the pre-processing unit, which converts pre-processed 
sensor values to equation error values that contain mainly measurement 
noise; 

A structured residual unit coupled to the model unit, which contains a plurality 
of transforms, referred to as structured residual transforms, each such 
transform converting equation error values to a structured residual 
value, and each such transform designed to be insensitive to faults in a 
subset of sensors; 

A detection unit coupled to the model unit, the detection unit monitoring the 
relationship among the equation error values, occurrence of a 
significant deviation of said relationship from expected relationship 
resulting in a detection event; 

An identification unit coupled to the structured residual unit and the detection 
unit, the identification unit being activated by a detection event, and 
using the stmctured residual values to determine if one or more sensors 
are faulty, said determination resulting in an identification event; 

An estimation unit coupled to the pre-processing unit, the structured residual 
imit and the identification unit, the estimation unit being activated by 
an identification event, and estimating fault sizes for each of the 
identified faulty sensors; 
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A replacement unit coupled to the estimation unit, the replacement unit 

calculating replacement values for the faulty measured sensor values in 
the working signal values by subtracting the estimated fault size from 
the corresponding measured sensor value for all identified faults; 

5 A classification unit coupled to the estimation unit, the classification, unit 

being active when the estimation unit is active, and classifying the 
identified sensor faults into a fixed set of fault types. 

2. The apparatus of claim 1 wherein: 

The normalizing in the pre-processing units is achieved by scaling and 
1 0 offsetting the measured sensor values. 

3. The apparatus of claim 1 wherein: 

The working signal includes known status information about the measured 
sensor values. 

4. The . apparatus of claim 1 wherein: 

15 The converting in the model omit is achieved by multiplying the pre-processed 

sensor values by a matrix to produce the equation error. 

5. The apparatus of claim 4 wherein: 

The matrix is derived from the residual part of a principal component analysis. 

6. The apparatus of claim 4 wherein: 

20 The matrix is derived from the residual part of a set of partial least squares 

models, one for each sensor value. 

7. The apparatus of claim 4 wherein: 

The matrix is derived from mass balance or energy balance of the measured 
process. 



25 



8. The apparatus of claim 1 wherein: 
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Each transform of the structured residual unit is in the form of a vector dot 
product with the equation error. 

9. The apparatus of claim 1 wherein: 

Each transform of the structured residual unit is designed to be insensitive to 
5 faults in a subset of sensors, but maximally sensitive to faults in all 

other sensors not in the subset. 

10. The apparatus of claim 1 wherein: 

Each transform of the structured residual unit is designed to be insensitive to a 
fault in single sensor, but maximally sensitive to faults in all other 
10 sensors. 

11. The apparatus of claim 1 wherein: 

The subset of sensors defining each transform includes at least all sensors of 
known bad status. 

12. The apparatus of claim 1 wherein the detection unit monitors the relationship 
1 5 among the equation error values by: 

calculating a detection index which is a function of the equation errors; and 

comparing said detection index to a threshold in order to detect occurrence of a 
significant deviation of said relationship from expected relationship. 

13. The apparatus of claim 12 wherein: 

20 The detection index is obtained by surruning the squared values of the 

equation error values. 

14. The apparatus of claim 12 wherein: 

The equation error is multiplied by a matrix to decorrelate the equation error 
values, resulting in decorrelated equation error values; and 

25 The detection index is obtained by summing the squared values of the 

decorrelated equation error values. 
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15. The apparatus of claim 13 or claim 14 wherein: 

The threshold is determined using statistical techniques. 

16. The apparatus of claim 13 or claim 14 wherein: 

The detection index is filtered, at least according to time, in order to smooth 
5 out the effects of transients and noise, resulting in a filtered detection 

index; and 

said filtered detection index is used in place of the detection index to monitor 
the relationship among the equation error values; and 

said filtered detection is compared to a threshold in order to detect occurrence 
10 of a significant deviation of said relationship &om expected 

relationship. 

17. The apparatus of claim 16 wherein: 

the detection index is filtered by applying an exponentially weighted moving 
average filter. 

15 18. The apparatus of claim 1 7 wherein: 

The threshold for the filtered detection index is calculated fi-om the detection 
index threshold using an auto-correlation fimction. > 

19. The apparatus of claim 1 wherein: 

The identification unit compares each structured residual value to a 
20 corresponding threshold; and 

An identification event occurs if the value of all but one structured residual 

value, referred to as the identified structured residual value, exceeds its 
corresponding threshold; and 

The determined faulty sensors are the subset of sensors for which, by design, 
25 the structxired residual transform corresponding to the identified 

structured residual value is insensitive to the presence of faults in said 
subset. 
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20. The apparatus of claim 1 wherein the identification unit applies conversion 
operations to the structured residual values resulting in converted structured 
residual indices and 

The identification unit compares each converted structured residual index to a 
5 corresponding threshold; and 

An identification event occurs if the converted structured residual index of all 
but one structured residual, referred to as the identified converted 
structured residual index, exceeds its corresponding threshold; and 

The determined faulty sensors are the subset of sensors for which, by design, 
10 the structured residual transform corresponding the converted 

structured residual index is insensitive to the presence of faults in said 
subset. 

21 . The apparatus of claim 20 wherein: 

The conversion operation includes the operations of squaring and scaling. 

15 22. The apparatus of claim 20 wherein: 

The conversion operation includes applying an exponentially weighted 
moving average filter in time. 

23. The apparatus of claim 22 wherein: 

The threshold for each converted structured residual index is calculated from 
20 the corresponding structured residual threshold using an auto- 

correlation function. 

24. The apparatus of claim 1 wherein the identification unit implies accumulating 
operations to the structured residual values resulting in accimiulated structured 
residual indices, said operations accumulating since the time of the fault detection 

25 event, and 

The identification unit compares each accumulated structured residual index to 
a corresponding threshold; and 
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An identification event occurs if the acciimulated structured residual index of 



all but one structured residual, referred to as the identified accumulated 
structured residual index, exceeds its corresponding threshold; and 



5 



The determined faulty sensors are the subset of sensors for which, by design, 
the structured residual transform corresponding to the identified 
accvunulated structured residual index is insensitive to the presence of 
faults in said subset. 



25. The apparatus of claim 24 wherein: 

The accumulating operation calculates a generalized likelihood ratio index that 



structured residuals since the time of the fault detection event. 

26. The apparatus of claim 24 wherein: 

The accumulating operation calculates the statistical mean of the structured 
residuals since the time of the fault detection event, resulting in an 



27. The apparatus of claim 24 wherein: 

The accumulating operation calculates the statistical variance of the structured 
residuals since the time of the fault detection event, resulting in an 
accumulated variance index. 

20 28. The apparatus of claim 1 wherein: 

The estimated fault size for each of the identified sensor faults is calculated by 
minimizing the effect of said identified sensor faults on the equation 
error values. 

29. The apparatus of claim I wherein: 
25 The classification unit calculates a plurality of regression lines, one for each 



10 



is designed to detect significant changes in the statistical mean of the 



15 



accumulated mean index. 



identified faulty sensor, each such regression line calculated using the 
measured sensor values for the corresponding faulty sensor since the 
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time of identification, resulting in a plurality of sensor value regression 
lines; and 

The classification unit calculates a plurality of regression lines, one for each 
identified faulty sensor, each such regression line calculated using 
5 estimated fault sizes for the corresponding faulty sensor since the time 

of identification, result in a plurality of fault size regression lines; and 

The classification unit uses slope, bias, and residual information firom sensor 
value regression lines and fault size regression lines to classify the 
identified sensor faults into a fixed set of fault types. 

10 30. The apparatus of claim 29 wherein: 

A faulty sensor is classified as type "complete failure" if the residual of the 

corresponding sensor value regression line is below a threshold, and if 
the slope of the corresponding sensor value regression line is 
statistically equal to zero, 

15 31. The apparatus of claim 29 wherein: 

A faulty sensor is classified as type '*bias'* if the residual of the corresponding 
fault size regression line is below a threshold, and if the slope of the 
corresponding fault size regression line is statistically equal to zero, 
and if the bias of the corresponding fault size regression line is 
20 statistically unequal to zero. 

32. The apparatus of claim 29 wherein: 

A faulty sensor is classified as type ''drift" if the residual of the corresponding 
fault size regression line is below a threshold, and if the slope of the 
corresponding fault size regression line is statistically unequal to zero. 

25 33. The apparatus of claim 29 wherein: - 

A faulty sensor is classified as type ''precision loss'' if the residual of the 

corresponding fault size regression line is abqve a threshold, and if the 
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slope and bias of the corresponding fault size regression line are both 
statistically equal to zero. 

34. The apparatus of claim 26 wherein: 

A faulty sensor is classified as type "precision loss" if the identification event 
S is triggered by an accumulated variance index exceeding its threshold. 

35. A computer method for detecting one or more sensor faults in a measured process 
which comprises the steps: 

Receiving a working vector of signals including measured sensor values, and 
preprocessing the measured sensor values, resulting in pre-processed 
10 sensor values; 

Converting the pre-processed sensor values to equation error values that 
contain mainly measurement noise; 

Applying a plurality of transforms to the equation error values resulting in a 
plurality of structured residual values, said transforms referred to as 
15 structured residual transforms and designed to be insensitive to faults 

in a subset of sensors; 

Monitoring the relationship among the equation error values, occurrence of a 
significant deviation of said relationship &om expected relationship 
resulting in a detection event; 

20 In the case that a detection event occurs, using the structured residual values to 

determine if one or more sensors are faulty, said determination 
resulting in an identification event; 

In the case that an identification event occurs, estimating fault sizes for each of 
the identified faulty sensors; 

25 In the case that an identification event occurs, replacing faulty measured 

sensor values in the working signal with corrected values by 
subtracting the estimated fault size firom the corresponding measured 
sensor value for all identified faults; 
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In the case that an identification event occurs, classifying the identified sensor 
faults into a fixed set of fault types. 

36. The method of claim 35 wherein: 

The step of pre-processing the measured sensor values is achieved by scaling 
S and offsetting. 

37. The method of claim 35 wherein: 

The working signal includes known status information about the measured 
sensor values. 

38. The method of claim 35 wherein: 

10 The step of converting tfie pre-processed sensor values to equation error values 

is achieved by multiplying the pre-processed sensor values by a matrix. 

39. The method of claim 38 wherein: 

The matrix is derived from the residual part of a principal component analysis. 

40. The method of claim 38 wherein: 

1 5 The matrix is derived fi*om the residual part of a set of partial least squares 

models, one for each sensor value. 

41. The method of claim 38 wherein: 

The matrix is derived firom mass balance or energy balance of the measured 
process. 

20 42. The method of claim 35 wherein: 

Each structured residual transform consists of a vector of coefficients that are 
^plied as a dot product to the equation error. 

43. The method of claim 35 wherein: 



wo 00/1 0059 PCTAJS98/22772 

-40- 

Each structured residual transform is designed to be insensitive to faults in a 
subset of sensors, but maximally sensitive to faults in all other sensors 
not in the subset. 

44. The method of claim 35 wherein: 

5 Each structured residual transform is designed to be insensitive to a fault in 

single sensor, but maximally sensitive to faults in all other sensors. 

45. The method of claim 35 wherein: 

The subset of sensors defining each transform includes at least all sensors of 
known bad status. 

10 46. The method of claim 35 wherein the step of monitoring the relationship among the 
equation error values consists of: 

calculating a detection index which is a function of the equation errors; and 

comparing said detection index to a threshold in order to detect occurrence of a 
significant deviation of said relationship from expected relationship. 

15 47. The method of claim 46 wherein: 

The detection index is obtained by summing the squared values of the 
equation error values. 

48. The method of claim 46 wherein: 

The equation error is multiplied by a matrix to decorrelate the equation. error 
20 values, resulting in decorrelated equation error values; and 

The detection index is obtained by summing the squared values of the 
decorrelated equation error values. 

49. The method of claim 47 or claim 48 wherein: 

The threshold is determined using statistical techniques. 

25 50. The method of claim 47 or claim 48 wherein: 
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The detection index is filtered, at least according to time, in order to smooth 
out the effects of transients and noise, resulting in a filtered detection 
index; and 

said filtered detection index is used in place of the detection index to monitor 
5 the relationship among the equation error values; and 

said filtered detection is compared to a threshold in order to detect occurrence 
of a significant deviation of said relationship from expected 
relationship. 

5 1 . The method of claim 50 wherein: 

10 the detection index is filtered by applying an exponentially weighted moving 

average filter, 

52. The method of claim 51 wherein: 

The threshold for the filtered detection index is calculated from the detection 
index threshold using an auto-correlation fimction. 

15 53. The method of claim 35 wherein the step of determining if one or more sensors 
are faulty consists of: 

Comparing each structured residual value to a corresponding threshold; and 

Generating an identification event if the value of all but one structured 

residual value, referred to as the identified structured residual value, 
20 exceeds its corresponding threshold; and 

Determining that the faulty sensors are the subset of sensors for which, by 
design, the structured residual transform corresponding to the 
identified structured residual value is insensitive to the presence of 
faults in said subset. 



25 



54. The method of claim 35 wherein conversion operations are applied to the 

structured residual values resulting in converted structured residual indices and the 
step of determining if one or more sensors are faulty consists of: 
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Comparing each converted structured residual index to a corresponding 
threshold; and 

Generating an identification event if the converted structured residual index of 
all but one structured residual, referred to as the identified converted 
S structured residual index, exceeds its corresponding threshold; and 

Determining that the faulty sensors are the subset of sensors for which, by 

design, the structured residual transform corresponding the converted 
structured residual index is insensitive to the presence of faults in said 
subset. 

10 55. The method of claim 54 wherein: 

The conversion operation includes the operations of squaring and scaling. 

56. The method of claim 54 wherein: 

The conversion operation includes applying an exponentially weighted 
moving average filter in time. 

1 5 57. The method of claim 56 wherein: 

The threshold for each converted structured residual index is calculated firom 
the corresponding structured residual threshold using an auto- 
correlation function. 

58. The method of claim 35 wherein accumulating operations are applied to the 
20 structured residual values resulting in accxunulated structured residual indices, said 

operations accimiulating since the time of the fault detection event, and the step of 
determining if one or more sensors are faulty consists of: 

Comparing each accumxilated structured residual index to a corresponding 
threshold; and 

25 Generating an identification event if the accumulated structured residual index 

of all but one structured residual, referred to as the identified 
accumulated structured residual index, exceeds its corresponding 
threshold; and 
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Determining that the faulty sensors are the subset of sensors for which, by 
design, the structured residual transform corresponding to the 
identified accumulated structured residual index is insensitive to the 
presence of faults in said subset. 

5 59. The method of claim 58 wherein: 

The accumulating operation calculates a generalized likelihood ratio index that 
is designed to detect significant changes in the statistical mean of the 
structured residuals since the time of the fault detection event. 

60. The method of claim 58 wherein: 

1 0 The accumulating operation calculates the statistical mean of the structured 

residuals since the time of the fault detection event, resulting in an 
accumulated mean index. 

61 . The method of claim 58 wherein: 

The accumulating operation calculates the statistical variance of the structured 
15 residuals since the time of the fault detection event, resulting in an 

accumulated variance index. 

62. The method of claim 35 wherein: 

The estimated fault size for each of the identified sensor faults is calculated by 
minimizing the effect of said identified sensor faults on the equation 
20 error values. 

63. The method of claim 35 wherein the step classifying tiie identified sensor faults 
into a fixed set of fault types is achieved by: 

Calculating a plurality of regression lines, one for each identified faulty 

sensor, each such regression line calculated using the measured sensor 
25 values for the corresponding faulty sensor from the time of 

identification, resulting in a plurality of sensor value regression lines; 
and 
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Calculating a plurality of regression lines, one for each identified faulty 

sensor, each such regression line calculated using estimated fault sizes 
for the corresponding faulty sensor from the time of identification, 
result in a plurality of fault size regression lines; and 

S Using slope, bias, and residual information firom sensor value regression lines 

and fault size regression lines to classify the identified sensor faults 
into a fixed set of fault types. 

64. The method of claim 63 wherein: 

A faulty sensor is classified as type "complete failure" if the residual of the 
10 corresponding sensor value regression line is below a threshold, and if 

the slope of the corresponding sensor value regression line is 
statistically equal to zero. 

65. The method of claim 63 wherein: 

A faulty sensor is classified as type "bias** if the residual of the corresponding 
1 5 fault size regression line is below a threshold, and if the slope of the 

corresponding fault size regression line is statistically equal to zero, 
and if the bias of the corresponding fault size regression line is 
statistically unequal to zero. 

66. The method of claim 63 wherein: 

20 A faulty sensor is classified as type "drift" if the residual of the corresponding 

fault size regression line is below a threshold, and if the slope of the 
corresponding fault size regression line is statistically unequal to zero. 

67. The method of claim 63 wherein: 

A faulty sensor is classified as type "precision loss" if the residual of the 
25 corresponding fault size regression line is above a threshold, and if the 

slope and bias of the corresponding fault size regression line are both 
statistically equal to zero. 



68. The method of claim 60 wherein: 
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A faulty sensor is classified as type ^'precision loss" if the identification event 
is triggered by an accumulated variance index exceeding its threshold. 
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AMENDED CLAIMS 
[received by the International Bureau on 1 8 May 1 999 (1 8.05.99); 
original claims 1-68 replaced by new claims 1-25 (10 pages)] 

1 . An apparatus for detecting one or more sensor faults in a measured process, 

said apparatus comprising: 

a pre-processing unit for receiving a working vector of signals 
including measured sensor values, the pre-processing unit having means for 
normalizing the measured sensor values, resulting in pre-processed sensor 
values; 

a model unit coupled to the pre-processing unit, which converts pre- 
processed sensor values to equation error values that contain mainly 
measurement noise; 

a structured residual unit coupled to the model unit, which contains a 
plurality of transforms, referred to as structured residual transforms, each 
such transform converting equation error values to a structiu-ed residual 
value, and each such transform designed to be insensitive to faults in a subset 
of sensors; 

a detection unit coupled to the model imit, the detection imit 
monitoring the relationship among the equation error values, occurrence of a 
significant deviation of said relationship from expected relationship resulting 
in a detection event; 

an identification imit coupled to the structured residual unit and the 
detection unit, the identification unit being activated by a detection event, 
and using the structured residual values to determine if one or more sensors 
are faulty, said detennination resulting in an identification event; 

an estimation unit coupled to the pre-processing unit, the structured 
residual imit and the identification unit, the estimation imit being activated 
by an identification event, and estimating fault sizes for each of the identified 
faulty sensors; 

a replacement imit coupled to the estimation unit, the replacement 
unit calculating replacement values for the faulty measured sensor values in 
the working signal values by subtracting the estimated fault size from the 
corresponding measured sensor value for all identified faults; and 
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a classification unit coupled to the estimation unit, the classification 
unit being active when the estimation unit is active, and classifying the 
identified sensor faults into a fixed set of fauh types. 

2. The apparatus of claim 1 wherein: 

S the normalizing in the pre-processing units is achieved by scaling and 

offsetting the measured sensor values, and wherein: 

the working vector of signals includes known status 
information about the measured sensor values, and wherein: 

the converting of the preprocessed sensor values in the 
10 model imit is achieved by multiplying the preprocessed sensor 

values by a matrix to produce the equation error. 

3. The apparatus of claim 2 wherein the matrix is derived from one of the 
following: 

(i) the residual part of a principal component analysis; 
15 (ii) a residual part of a set of partial least squares models, one for 

each sensor value; and 

(iii) mass balance or energy balance of the measured process. 

4. The apparatus of claim 1 wherein: 

a subset of sensors defining each transform includes at least all 
20 sensors of known bad status. 

5. The apparatus of claim 1 wherein the detection unit monitors the relationship 
among the equation error values by: 

calculating a detection index which is a fimction of the equation 
errors; and 

25 comparing said detection index to a threshold in order to detect 

occurrence of a significant deviation of said relationship fix>m expected 
relationship, wherein, further, the detection index is obtained by summing 
squared values of the equation error values. 
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6. The apparatus of claim 5 wherein: 

the equation error is multiplied by a matrix to decorrelate the 
equation error values^ resulting in decorrelated equation error values; and 

the detection index is obtained by summing the squared values of the 
S decorrelated equation error values, wherein: 

the threshold is determined using statistical techniques. 

7. The apparatus of claim S or claim 6 wherein: 

the detection index is filtered, at least according to time, in order to 
smooth out the effects of transients and noise, resulting in a filtered detection 
10 index; and 

said filtered detection index is used in place of said detection index to 
monitor a relationship among the equation error values; and wherein 

said filtered detection index is compared to a threshold in 
order to detect occurrence of a significant deviation of said 
1 S relationship from expected relationship. 

8. The apparatus of claim 7 wherein: 

the detection index is filtered by applying an exponentially weighted 
moving average filter, wherein a threshold for the filtered detection index is 
calculated from the detection index threshold using an auto-correlation 
20 function. 

9. The apparatus of claim 1 wherein: 

the identification unit compares each structured residual value to a 
corresponding threshold; 

an identification event occurs if the value of all but one structured 
25 residual value, referred to as the identified structiired residual value, exceeds 

its corresponding threshold; and 

the determined faulty sensors are a subset of sensors for which, by 
design, a structured residual transform corresponding to an identified 
structured residual value is insensitive to the presence of faults in said subset. 
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The apparatus of claim 1 wherein: 

the identification unit applies conversion operations to the structured 
residual values resulting in converted structured residual indices; 

the identification unit compares each converted structured residual 
index to a corresponding threshold; 

an identification event occurs if the converted structured residual 
index of all but one structured residual index, referred to as the identified 
converted structured residual index, exceeds its corresponding threshold; and 

the determined faulty sensors are a subset of sensors for which, by 
design, a structured residual transform corresponding the converted 
structured residual index is insensitive to the presence of faults in said 
subset, wherein: 

the conversion operation includes the operations of squaring 

and scaling. 

The apparatus of claim 10 wherein: 

the conversion operation includes applying an exponentially 
weighted moving average filter in time, wherein the threshold for each 
converted structured residual index is calculated firom the corresponding 
structured residual threshold using an auto-correlation fimction. 

The apparatus of claim 1 wherein: 

the identification unit applies accumulating operations to the 
structured residual values resulting in accumulated structured residual 
indices, said op^ations accumulating since the time of the fault detection 
event; 

the identification unit compares each accumulated structured residual 
index to a corresponding threshold; 

an identification event occurs if the accumulated structured residual 
index of all but one structured residual, referred to as the identified 
accumulated structiu^ residual index, exceeds its corresponding threshold; 
and 
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the determined faulty sensors are the subset of sensors for which» by 
design, the structured residual transform corresponding to the identified 
accumulated structured residual index is insensitive to the presence of faults 
in said subset, wherein the acciunulating operation calculates a generalized 
likelihood ratio index that is designed to detect significant changes in the 
statistical mean of the structured residuals since the time of the fault 
detection event. 

13. The apparatus of claim 1 wherein: 

the classification unit calculates a plurality of regression lines, one 
for each identified faulty smsor, each such regression line being calculated 
using the measured sensor values for the corresponding faulty sensor since 
the time of identification, resulting in a plurality of sensor value regression 
lines; 

the classification unit calculates a plurality of regression lines, one 
for each identified faulty sensor, each such regression line being calculated 
using estimated fault sizes for the corresponding faulty sensor since the time 
of identification, resulting in a plurality of fault size regression lines; and 

the classification unit uses slope, bias, and residual information fi-om 
sensor value regression lines and fault size regression lines to classify the 
identified sensor faults into a fixed set of fault types, wherein fiuthen 

a faulty sensor is classified as type "complete failure** if the 

residual of the corresponding sensor value regression line is below a 

threshold, and if the slope of the corresponding seiisor value 

regression line is statistically equal to zero. 

14. A computer method for detecting one or more sensor faults in a measured 
process which comprises the steps: 

receiving a working vector of signals including measured sensor 
values, and preprocessing the measured sensor values, resulting in pre- 
processed smsor values; 

converting the pre-processed sensor values to equation error values 
that contain mainly measurement noise; 
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16. 



25 17, 



applying a plurality of transfoims to the equation error values 
resulting in a plurality of structured residual values, said transforms referred 
to as structured residual transforms and designed to be insensitive to faults in 
a subset of sensors; 

monitoring a relationship among the equation error values, an 
occurrence of a significant deviation of said relationship &om expected 
relationship resulting in a detection event; 

in the case that a detection event occurs, using the structured residual 
values to determine if one or more sensors are faulty, said determination 
resulting in an identification event; 

in the case that an identification event occurs, estimating fault sizes 
for each of the identified faulty sensors; 

in the case that an identification event occurs, replacing faulty 
measured sensor values in the woridng signal with corrected values by 
subtracting the estimated fault size from the corresponding measured sensor 
value for all identified faults; and 

in the case that an identification event occurs, classifying the 
identified sensor faults into a fixed set of fault types. 

The method of claim 14 wherein: 

the step of pre-processing the measured sensor values is achieved by 
scaling and offsetting. 

The method of claim 14 wherein: 

the woridng signal includes known status information about the 
measured sensor values. 

The method of claim 14 wherein: 

the step of converting the pre-processed sensor values to equation 
error values is achieved by multiplying the pre-processed sensor values by a 
matrix, wherein the matrix is derived bom one of the following: 



(i) 



the residual part of a principal component analysis; 
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(ii) the residual part of a set of partial least squares 
models, one for each sensor value; and 

(iii) mass balance or energy balance of the measured 
process. 

5 18. The method of clakn 14 wherein: 

each structured residual transform consists of a vector of coefficients 
that are applied as a dot product to the equation error, wherein: 

each structured residual transform is designed to be 
insensitive to faults in a subset of sensors, but maximally sensitive to 
10 faults in all other sensors not in the subset. 

19. The method of claim 14"wherein the step of monitoring the relationship 
among the equation error values consists of: 

calculating a detection index which is. a function of the equation 
errors; and 

1 5 comparing said detection index to a threshold in order to detect 

occurrence of a significant deviation of said relationship fix>m expected 
relationship. 

20. The method of claim 19 wherein: 

each of said equation error values is multiplied by a matrix to 
20 decorrelate the equation error values," resulting in decorrelated equation enror 

values; and 

the detection index is obtained by summing the squared values of the 
decorrelated equation error values, wherein: 

the threshold is determined using statistical techniques. 

25 21. The method of claim 20 wherein: 

the detection index is filtered, at least according to time, in order to 
smooth out the effects of transients and noise, resulting in a filtered detection 
index; 

said filtered detection index is used in place of the detection index to 
30 monitor the relationship among the equation error values; and 
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said filtered detection index is compared to a threshold in order to 
detect occurrence of a significant deviation of said relationship firom 
expected relationship, wherein fiirther, the detection index is filtered by 
applying an exponentially weighted moving average filter. 

S 22. The method of claim 14 wherein the step of determining if one or more 
sensors are faulty consists of: 

comparing each structured residual value to a conresponding 
threshold; 

generating an identification event if the value of all but one structured 
10 residual value, referred to as the identified structured residual value, exceeds 

its corresponding threshold; and 

determining that the faulty sensors are the subset of sensors for 
which, by design, the structured residual transform corresponding to the 
identified structured residual value is insensitive to the presence of faults in 
IS said subset. 

23, The method of claim 14 wherein conversion operations are applied to the 
structured residual values resulting in converted structured residual indices and the 
step of determining if one or more sensors are faulty consists of: 

comparing each converted structured residual index to a 
20 corresponding threshold; 

generating an identification event if the converted structured residual 
index of all but one structured residxial, referred to as the identified converted 
structured residual index, exceeds its corresponding threshold; and 

determining that the faulty sensors are the subset of sensors for 
25 which, by design, the structured residual transform corresponding the 

converted structured residual index is insensitive to the presence of fimlts in 
said subset, wherein, the conversion operation includes the operations of 
squaring and scaling. 

24. The method of claim 14 wherein accumulating operations are applied to the 
30 structured residual values resulting in accumulated structured residual indices, said 
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operations accumulating since the time of the fault detection event, and the step of 
determining if one or more sensors are faulty consists of: 

comparing each accumulated structured residual index to a 
corresponding threshold; 
5 generating an identification event if the accimiulated structured 

residual index of all but one structured residual* referred to as the identified 
accumulated structured residual index, exceeds its corresponding threshold; 
and 

determining that the faulty sensors are the subset of sensors for 
10 which, by design, the structured residual transform corresponding to the 

identified accumulated structured residual index is insensitive to the presence 
of faults in said subset, wherein, the accumulating operation calculates a 
generalized likelihood ratio index that is designed to detect significant 
changes in the statistical mean of the structured residuals since the time of 
15 the fault detection event. 

25. The method of claim 14 wherein the step classifying the identified sensor 
faults into a fixed set of fault types is achieved by: 

calculating a plurality of regression lines, one for each identified 
faulty sensor, each such regression line being calculated using measured 
20 sensor values for the corresponding faulty sensor from the time of 

identification, resulting in a plurality of sensor value regression lines; 

calculating a plurality of regression lines, one for each identified 
faulty sensor, each such regression line being calculated using estimated 
fault sizes for the corresponding faulty sensor firom the time of identification, 
25 result in a plurality of fault size regression lines; and 

using slope, bias, and residual information firom sensor value 
regression lines and fault size regression lines to classify the identified 
sensor faults into a fixed set of fault types, wherein further a faulty sensor is 
classified as one of the following: 
30 (i) a faulty sensor is classified as type "complete failure" 

if the residual of the corresponding sensor value regression line is 
below a threshold, and if the slope of the corresponding sensor value 
regression line is statistically equal to zero; 
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(ii) a faulty sensor is classified as type "bias" if the 
residual of the corresponding fault size regression line is below a 
threshold, and if the slope of the corresponding fault size regression 
line is statistically equal to zero, and if the bias of the corresponding 
fault size regression line is statistically unequal to zero; 

(iii) a faulty sensor is classified as type '"drift" if the 
residual of the corresponding fault size regression line is below a 
threshold, and if the slope of the corresponding fault size regression 
line is statistically unequal to zero; and 

(iv) a faulty sensor is classified as type "precision loss" if 
the residual of the corresponding fault size regression line is above a 
threshold, and if the slope and bias of the corresponding fault size 
regression line are both statistically equal to zero. 
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